General state space Markov chains and MCMC algorithms
نویسندگان
چکیده
This paper surveys various results about Markov chains on general (non-countable) state spaces. It begins with an introduction to Markov chain Monte Carlo (MCMC) algorithms, which provide the motivation and context for the theory which follows. Then, sufficient conditions for geometric and uniform ergodicity are presented, along with quantitative bounds on the rate of convergence to stationarity. Many of these results are proved using direct coupling constructions based on minorisation and drift conditions. Necessary and sufficient conditions for Central Limit Theorems (CLTs) are also presented, in some cases proved via the Poisson Equation or direct regeneration constructions. Finally, optimal scaling and weak convergence results for Metropolis-Hastings algorithms are discussed. None of the results presented is new, though many of the proofs are. We also describe some Open Problems. Received March 2004.
منابع مشابه
4 General State Space Markov Chains and Mcmc Algorithms
Abstract. This paper surveys various results about Markov chains on general (noncountable) state spaces. It begins with an introduction to Markov chain Monte Carlo (MCMC) algorithms, which provide the motivation and context for the theory which follows. Then, sufficient conditions for geometric and uniform ergodicity, along with quantitative bounds on the rate of convergence to stationarity in ...
متن کاملParticle Markov Chain Monte Carlo
Markov chain Monte Carlo (MCMC) and sequential Monte Carlo (SMC) methods have emerged as the two main tools to sample from high-dimensional probability distributions. Although asymptotic convergence of MCMC algorithms is ensured under weak assumptions, the performance of these latters is unreliable when the proposal distributions used to explore the space are poorly chosen and/or if highly corr...
متن کاملOrthogonal parallel MCMC methods for sampling and optimization
Monte Carlo (MC) methods are widely used in statistics, signal processing and machinelearning. A well-known class of MC methods are Markov Chain Monte Carlo (MCMC)algorithms. In order to foster better exploration of the state space, specially in high-dimensional applications, several schemes employing multiple parallel MCMC chains have beenrecently introduced. In this work, ...
متن کاملNonasymptotic bounds on the estimation error for regenerative MCMC algorithms∗
MCMC methods are used in Bayesian statistics not only to sample from posterior distributions but also to estimate expectations. Underlying functions are most often defined on a continuous state space and can be unbounded. We consider a regenerative setting and Monte Carlo estimators based on i.i.d. blocks of a Markov chain trajectory. The main result is an inequality for the mean square error. ...
متن کاملMarkov Chain Monte Carlo Algorithm and Its Rate of Convergence
Preface This report is an overview and summary of the supervised reading course I took under the supervision of Professor Rosenthal at Unversity of Toronto in fall 2014. The first part of this report summarizes my study about the Markov chains on general state space. I focused on papers by Rosenthal [5], [7] and the textbook by Meyn and Tweeide [3]. The second part discusses the Markov Chain Mo...
متن کامل